Context aware Q-Learning-based model for decision support in the negotiation of energy contracts

[EN] Automated negotiation plays a crucial role in the decision support for bilateral energy transactions. In fact, an adequate analysis of past actions of opposing negotiators can improve the decision-making process of market players, allowing them to choose the most appropriate parties to negotiate with in order to increase their outcomes. This paper proposes a new model to estimate the expected prices that can be achieved in bilateral contracts under a specific context, enabling adequate risk management in the negotiation process. The proposed approach is based on an adaptation of the Q-Learning reinforcement learning algorithm to choose the best scenario (set of forecast contract prices) from a set of possible scenarios that are determined using several forecasting and estimation methods. The learning process assesses the probability of occurrence of each scenario, by comparing each expected scenario with the real scenario. The final chosen scenario is the one that presents the higher expected utility value. Besides, the learning method can determine which is the best scenario for each context, since the behaviour of players can change according to the negotiation environment. Consequently, these conditions influence the final contract price of negotiations. This approach allows the supported player to be prepared for the negotiation scenario that is the most probable to represent a reliable approximation of the actual negotiation environme

Multi-agent Electricity Markets and Smart Grids Simulation with Connection to Real Physical Resources

The increasing penetration of distributed energy sources, mainly based on renewable generation, calls for an urgent emergence of novel advanced methods to deal with the associated problems. The consensus behind smart grids (SGs) as one of the most promising solutions for the massive integration of renewable energy sources in power systems has led to the development of several prototypes that aim at testing and validating SG methodologies. The urgent need to accommodate such resources require alternative solutions. This chapter presents a multi-agent based SG simulation platform connected to physical resources, so that realistic scenarios can be simulated. The SG simulator is also connected to the Multi-Agent Simulator of Competitive Electricity Markets, which provides a solid framework for the simulation of electricity markets. The cooperation between the two simulation platforms provides huge studying opportunities under different perspectives, resulting in an important contribution to the fields of transactive energy, electricity markets, and SGs. A case study is presented, showing the potentialities for interaction between players of the two ecosystems: a SG operator, which manages the internal resources of a SG, is able to participate in electricity market negotiations to trade the necessary amounts of power to fulfill the needs of SG consumers.This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement N. 641794 (project DREAM-GO). It has also received FEDER Funds through the COMPETE program and National Funds through FCT under the project UID/EEA/00760/2013. The authors gratefully acknowledge the valuable contribution of Bruno Canizes, Daniel Paiva, Gabriel Santos and Marco Silva to the work presented in the chapter.info:eu-repo/semantics/publishedVersio

Nord Pool Ontology to Enhance Electricity Markets Simulation in MASCEM

This paper proposes the use of ontologies to enable information and knowledge exchange, to test different electricity market models and to allow players from different systems to interact in common market environments. Multi-agent based software is particularly well fitted to analyse dynamic and adaptive systems with complex interactions among its constituents, such as the complex and dynamic electricity markets. The main drivers are the markets’ restructuring and evolution into regional and continental scales, along with the constant changes brought by the increasing necessity for an adequate integration of renewable energy sources. An ontology to represent the concepts related to the Nord Pool Elspot market is proposed. It is validated through a case study considering the simulation of Elspot market. Results show that heterogeneous agents are able to effectively participate in the simulation by using the proposed ontologies to support their communications with the Nord Pool market operator.This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 641794 (project DREAM-GO) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013.info:eu-repo/semantics/publishedVersio

How manipulating task constraints in small-sided and conditioned games shapes emergence of individual and collective tactical behaviours in football: A systematic review

Background: Small-Sided and Conditioned Games are characterised by modifications of field dimensions, number of players, rules of the game, manipulations used to shape the key task constraints that performers need to satisfy in practice. Evidence has already demonstrated the importance of designing practice to enhance understanding of tactical behaviours in football, but there is a lack of information about how coaches can manipulate task constraints to support tactical learning. Objective: To investigate which task constraints have been most often manipulated in studies of SSCGs; and what impact each manipulation had on emerging tactical behaviours, technical–tactical actions, and positional relationships between players. Methods: PubMed, Web of Science, Scielo, and Academic Google databases were searched for relevant reports without time limits. The criteria adopted for inclusion were: a) studies performed with football players; b) studies that included SSCGs as an evaluation method; c) studies that investigated tactical behaviours in SSCGs; and d), articles in English and Portuguese. Results: The electronic database search included 24 articles in the review. Of these, five manipulated field dimensions, six manipulated number of players involved, five manipulated field dimensions and number of players, five used different scoring targets, two altered the number of players and scoring target, and one manipulated the number of players, field dimension, and scoring target. Conclusion: Among the task constraints analyzed in this systematic review, manipulation of number of players and playing field dimensions concomitantly occurred most frequentl

How manipulating task constraints in small-sided and conditioned games shapes emergence of individual and collective tactical behaviours in football: A systematic review

Background: Small-Sided and Conditioned Games are characterised by modifications of field dimensions, number of players, rules of the game, manipulations used to shape the key task constraints that performers need to satisfy in practice. Evidence has already demonstrated the importance of designing practice to enhance understanding of tactical behaviours in football, but there is a lack of information about how coaches can manipulate task constraints to support tactical learning. Objective: To investigate which task constraints have been most often manipulated in studies of SSCGs; and what impact each manipulation had on emerging tactical behaviours, technical–tactical actions, and positional relationships between players. Methods: PubMed, Web of Science, Scielo, and Academic Google databases were searched for relevant reports without time limits. The criteria adopted for inclusion were: a) studies performed with football players; b) studies that included SSCGs as an evaluation method; c) studies that investigated tactical behaviours in SSCGs; and d), articles in English and Portuguese. Results: The electronic database search included 24 articles in the review. Of these, five manipulated field dimensions, six manipulated number of players involved, five manipulated field dimensions and number of players, five used different scoring targets, two altered the number of players and scoring target, and one manipulated the number of players, field dimension, and scoring target. Conclusion: Among the task constraints analyzed in this systematic review, manipulation of number of players and playing field dimensions concomitantly occurred most frequentl